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EXPRESS MAIL MAILING LABEL NO. EV174099892US 

PATENT APPLICATION 
DOCKET NO. : CBA-004 

ANALOG CONTINUOUS TIME STATISTICAL PROCESSING 

Related Application 

[0001] This application claims the benefits of U.S. 

Provisional Application Serial No. 60/418,604, filed on 
October 15, 2002, the entire disclosure of which is hereby 
incorporated by reference. 

Field of Invention 

[0002] The invention relates to the field of signal 

processing. More particularly, the invention relates to 
the field of probabilistic analog signal processing. 

j 

Background •'• 

i 

.ft 

[0003] Many methods of digital communication rely % 

on representing binary data with what is inherently an 
analog signal, an electromagnetic wave. At a transmitter, 
digital signals originally take the form of a series of 

squared-off dips and pulses. During transmission of the ,| 
signal, characteristics of the communication channel over 
which the signal is sent distort^ the pulses. On receipt of 
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such a signal, before using the data in the transmission, 
the receiver must first decipher from the incoming wave 
what data the sender intended to transmit. Thus, 
transmitters send symbols encoded as analog signal 
waveforms, and receivers convert the waveforms back into 
symbols. An analog- to-digital (A/D) converter in the 
receiver samples the waveform and outputs a series of 
binary numbers representing the waveform as a discretized 
time series. This digital representation is then amenable 
to signal processing by a digital computer. 

[0004] Sampling with more bits of resolution 

preserves more of the information in the received waveform 
and therefore enables more accurate decoding of its 
information content by the receiver, but consumes more 
power and silicon "real estate" in the A/D converter. In 
general, a higher-resolution digital representation also 
requires a larger and more powerful digital computer. 

[0005] Receiving systems have employed two types of 

A/D converters to guess the intended values of components 
of incoming signal. In both cases, the converters average 
the value of the signal over a predetermined period of 
time. One class of converters compares the magnitude of 
that average to a threshold. If the magnitude of the 



averaged sample exceeds the threshold, the converter 
assumes that the transmitter intended to send a bit 
representing a one. If the magnitude fails to cross the 
threshold, the A/D converter assumes that the transmitter 
intended to send a zero. Basing a guess on a fixed 
threshold is vulnerable to inaccuracy due to noise and 
other forms of signal interference. Merely because a 
sample value falls below, for example, the midpoint between 
voltage levels corresponding to zero and one does not 
guarantee that a zero was in fact transmitted. 

[0006] The second type of A/D converter 

incorporates the information that can be gleaned from the 
exact magnitude of a sampled signal. This magnitude is 
stored as a series of bits (CD players use 10 bits, for 
example) . With this series of bits, the system can use 
decoding algorithms and digital logic operations 
representing probabilistic -functions to guess the intended 
value of a received bit with more accuracy than could be 
done with a thresholding system. Implementing this second 
approach, however, typically requires the use of thousands 
of transistors and a relatively large amount of power. 

[0007] In order to more accurately guess the 

intended values of a received signal component at a given 
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time point, a receiving system ordinarily synchronizes 
itself with the incoming data stream. Synchronization 
prevents the receiving system from attempting to guess the 
intended value of a signal component over a time in which 
the intended value of that signal is in transition. 
[0008] Synchronization has been achieved by the 

receiver using phase lock loops (PLLs) or by the sender 
transmitting a synchronization signal along with data. 
PLLs are typically power-hungry while sending a 
synchronization signal wastes bandwidth. Accordingly, the 
power necessary to operate the value guessing and 
synchronization logic in traditional communications systems 
tends to require the use of large batteries, frequent 
recharges, or both. 



Summary of the Invention 

[0009] In general, the invention relates to 

continuous -time .analog computation, in particular to 
implementation of statistical signal processing using 
continuous -time analog circuits. This approach may, for 
example, be used to replace the discrete-time digital 
signal processing elements currently in use. The invention 
can therefore lead to an increase in processing speed and 
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avoids the power usage associated with digital logic. As a 
result, receiving systems can be built to be much lighter 
than their digital counterpart systems. Indeed, in some 
applications (such as semiconductor devices fabricated at 
an extremely small scale) , it may be difficult to avoid 
recognizing and explicitly handling analog signal 
attributes . 

[0010] Beyond this, the invention is applicable to 

computations intentionally performed on analog signals that 
do not encode digital information. 

[0011] In one aspect, the invention relates to a 

signal-processing apparatus comprising a plurality of 
continuous -time delay elements (e.g., filters) for 
receiving a time-varying signal. Each of the elements 
imposes a corresponding delay on the signal. A plurality 
of "soft gates" receive delayed components of the signal 
from the delay elements. The soft gates each produce an 
output based on probability distributions associated with 
different possible states of at least one signal component. 
In one embodiment, the delay elements are filters, and at 
least some of the filters are low-pass filters. In other 
embodiments, at least some of the filters are band-pass 
filters . 
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[0012] In a further embodiment, the delay elements 

cause a plurality of temporally distinct signal components 
to reach a soft gate simultaneously. In yet another 
embodiment the delay elements are filters that remove high- 
frequency noise from the signal. 

[0013] The soft gates may cooperate to effect a 

series of operations on the signal components. The 
operations are carried out in a predetermined order 
mandated by the connections between the gates and the 
delays imposed by the filters. The predetermined order may 
correspond to an algorithm, e.g., the belief propagation 
algorithm (see Yedidia.et al., "Constructing Free Energy 
Approximations and Generalized Belief Propagation 
Algorithms/' Mitsubishi Electric Research Laboratory, April 
2002; and Kschischang et al., "Factor Graphs and the Sum- 
Product Algorithm, " IEEE Trans. Info. Theory 47:498-519 

(2001) , both of which are incorporated herein and appended 
hereto) . y 

[0014] The invention may incorporate a receiving 

module for assigning probability values to different 
possible states of the signal when it arrives. The 
receiving module then communicates the probability values 



to the first of a cascaded series of soft gates that 
produce outputs based on those probability values. 

[0015] If the delay elements are used with a 

limited-bandwidth signal, then the injection of the 
received continuous -time waveform into the receiver system 
can lead to synchronization of the receiver system to the 
transmitter's symbol clock. Accordingly, in still another 
embodiment, a transmitter having a clock rate produces the 
received time-varying signal. The delay elements have a 
bandwidth with an upper bound approximating the frequency 
of the transmitter's clock rate. The delay elements 
cooperate with computational elements to synchronize the 
receiver's computations to the transmitter's clock. For 
example, the delay elements may be filters having cutoff 
frequencies no greater than the transmitter's clock rate, . 
which may cooperate with soft gates to synchronize 
performance of the series of logic operations to the 
transmitter' s clock. 

[0016] In another aspect, the invention relates to 

a method of signal -processing that includes the steps of 
receiving a time -varying signal, imposing a plurality of 
delays on the signal, and performing state-based operations 
on a plurality of delayed components of the signal based on 
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probability distributions associated with different 
possible states thereof. Once again, the order of the 
state-based operations and the values of the delays can 
correspond to an algorithm. 

[0017] In another aspect, the invention relates to 

a reconf igurable soft circuit and methods for such 
reconfiguration. The delays imposed by delay elements 
within the reconf igurable soft circuit can dynamically be 
altered. Similarly, the functions of the computational 
elements can also be dynamically altered, and interconnects 
between calculation elements and delays can also be 
rearranged. In such a reconf igurable soft circuit, the 
algorithm performed by the soft gates and filters in the 
matrix can be reprogrammed dynamically to perform other 
algorithms without requiring the manufacture of a new 
device . 

[0018] Other aspects of the invention related to 

apparatus for acquiring an encoded time-varying signal 
having a clock rate and having a plurality of signal 
components. The signal components each represent one of a 
discrete set of values. The apparatus include a receiver, 
a probability module for receiving the signal, and a noise - 
lock loop including a number of analog delays and analog 
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computational elements. The noise- lock- loop is configured 
to remove high-frequency noise from the signal and to 
synchronize the apparatus with the signal. In one 
embodiment the noise -lock loop of the apparatus also 
decodes the encoded time-varying signal. In another 
embodiment , the "apparatus' 7 corresponds to a user and the 
noise-lock loop operates to detect whether the user is the 
intended recipient of the time-varying signal. 

Brief Description of the Figures 
[0019] The foregoing discussion will be understood 

more readily from the following detailed description of the 
invention, when taken in conjunction with the accompanying 
drawings, in which: 

[0020] Figure 1 schematically depicts a simple 

analog multiplier. 

[0021] Figure 2 schematically depicts an 

implementation of a soft XOR gate. 

[0022] Figure 3 schematically depicts an 

implementation of a soft equals gate. 

[0023] Figure 4 schematically depicts an 

implementation of a reprogrammable soft gate. 

[0024] Figure 5 schematically depicts an 

implementation of a soft one-bit multiplexer. 

9 



[00253 Figure 6 schematically depicts an 

implementation of a MAND gate. 

[0026] Figure 7 depicts a train of analog filter 

delays . 

[0027] Figure 8 depicts a finite state machine for 

encoding a message . 

[0028] Figure 9 depicts the synchronization effects 

of analog filters. 

[0029] Figure 10 schematically depicts a spread 

spectrum transmitter and its corresponding receiver 
implemented with a noise lock loop. 

Detailed Description of the Preferred Embodiments 

[0030] The sum-product algorithm (also known as the 

"belief propagation" algorithm) and its approximations 
(such as max-product) operate by message passing on a 
probabilistic graphical model (PGM) . A growing number of 
statistical signal processing algorithms have been shown to 
be special cases of the sum-product algorithm on a 
particular PGM. Decoding algorithms, for example, can be 
described as Bayesian networks using sum-products. Sum 
product algorithms consist of a series of addition and/or 
multiplication steps. 
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[0031] Given a function with a discrete number of 

potential outcomes, a probability function P (X) , where X 
denotes the set of possible outcomes {xi,...,x m } can be 
defined such that £P(X=Xi) = l. The probability, therefore, 
that P(X=xi) (which can be denoted as P x (Xi)) for each x ± 
ranges from 0 to 1 (assuming non-negative probabilities) . 
Such a function can be modeled in circuit form by 
representing probabilities as percentages of a maximum 
current I x , i.e., I X/i = Ix Px(xi) and £I x ,i = Ix- 

[0032] In some embodiments of the invention the 

sum-product algorithm circuits mentioned above are 
implemented with analog components; for example, 
probabilities in the sum-product algorithm are represented 
by electrical currents or voltages. A probability of an 
outcome is represented by the fraction of a maximum 
potential current flowing through a system. 

[0033] Conceptually, a multiplier can be built with 

two transistors. If, as in Figure 1, two transistors, Tl 
and T2 are connected in series, emitter to collector, with 
each base, Bl and B2, being fed an input current, P 0 and Pi, 
equal to fractions of each of the transistors' saturation 
levels, the resulting current I 0 flowing through the 
transistors will equal the maximum potential current flow, 
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Imax, multiplied by the probabilities represented by P 0 and 
P x . (In actuality, a practical circuit would be 
differential and account for biasing.) 

[0034] Similarly, joining two wires together sums 

the current flowing in each. Combining these basic 
configurations into more complicated arrangements allows 
the design of a myriad of sum-product functions. Such 
models can be used to implement functions having any 
discrete number of potential outcomes. 

[0035] One embodiment of the invention uses 

functions that are binary, e.g., XOR and Equals. An XOR 
gate performs the mod- 2 addition function. In a fully 
digital circuit, the probability that the inputs and output 
of an XOR gate are 0 or 1 are either 0% or 100% (i.e., I Xfl 
= all or no current, I Xt0 = no or all current) . With an 
analog XOR gate, termed a "soft XOR," the probability that 
the inputs and outputs are either 0 or 1 can range between 
0% and 100% with the constraint that the probabilities for 
any set of corresponding inputs or outputs sum to 100%. 

[003 6] The soft XOR function (z) can be described 

as follows: 

Pz(0) = P x (0)P y (0) + P x (l)P y (l) 

Pz(D = Px(0)Py(l) + Px(0)Py(D 
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[0037] Figure 2 illustrates a conceptual circuit 

diagram for implementing a soft XOR 200. The gate takes 
as inputs the probabilities that two signal components, x 
and y, equal zero or that they equal 1. A series of 
current sources 201 y#0 , 201 x , 0 , 201 y#1 , 201 x ,i provide a 

maximum current of I max . The transistors in the center of 

c 

the diagram 202 carry out the necessary multiplication 
steps. The transistors 2 02 multiply P x (0) x P y (0) x I max ; 
Px(D x Py(D x I max; P x ( 0 ) x P y ( 1 ) x I max ; and P x ( 0 ) x P y (l) 
x Imax- The wire junctions 2 06 carry put the summation 
functions: P x (0) P y (0) I ma x + P x (1) P y (1) Imax/ and P x (0) P y (1) I ma x 
+ Px(0)Py(l) Imax- The outputs, P z ( 0 ) and P z (l) are equal to 
the result of the summations, matching the mathematical 
representation of the soft XOR gate. 

[0038] Some embodiments of the invention also 

incorporate soft " equals" gates as illustrated in Figure 3. 

[003 9] The soft equals gate performs the function: 

X Y Z 

1 1 -> 1 Pz(D = Px(D x P y (l) 

0 0 -> 0 P z (0) = P x (0) x P y (0) 

0 1 -> n/a • 

1 0 -> n/a 
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[0040] In one embodiment, a soft equals gate is 

used to determine the probability that two signal 
components are equal. 

[0041] As described in U.S. Patent No. 6,282,559, 

the entire disclosure of which is hereby incorporated by 
reference, similar circuits can be used to model a wide 
range of functions corresponding or reducible to sum- 
product computations. 

[0042] Soft gates can be created such that the 

operation they implement can be dynamically reprogrammed, 
as depicted in Figure 4. An exemplary reprogrammable soft 
gate 4 00 includes a reprogrammable controller 402, such as 
a field programmable gate array (FPGA) , that takes as 
inputs signals A, B, C, and D representing P x (0)P y (0), 
P x (l)P y (l), P x (l)P y (0), and P x (l) P y (0) , respectively, and 
control signals cO and cl. The controller outputs P z (0)and 
P z (l) representing some linear combination of the input 
signals A, B, C, and D. 

[0043] By varying the signals cO and cl, the 

reprogrammable soft gate 400 can be dynamically 
reprogrammed to perform at least the following sample 
operations: OR, AND, and XOR. These operations may be 
described by the following equations: 
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Control Inputs 


Operation Performed 


Output 


^ n _ n 

CU-U 


X ANT) Y 


Pz (0) =A + C 


+ D 


cl=l 




P 2 (1)=B 




c0 = 0 


X OR Y 


Pz (0) =A 




cl=l 




Pz (1) =B + C 


+ D 


cO=l 


X XOR Y 


P z (0) = A + 


B 


cl=l 




Pz(D = C + 


D 



Of course, in other embodiments, reprogrammable soft gates 
can accept more or different inputs and additional control 
signals to provide for additional functionality and 
functionality selection. 

[0044] Figure 5 is an illustrative soft one-bit 

multiplexer (SOM) 500 according to an embodiment of the 
invention. In digital logic, multiplexers provide routing 
functionality to direct digital signals to various other 
elements in a digital circuit. Soft multiplexers carryout 
a similar function for analog circuits. 
[0045] The illustrative SOM 500 is the analog 

equivalent of a digital one-bit multiplexer, which receives 
as inputs an address signal and data. If the address 
signal corresponds to a 1, the data is transmitted to a 
first target. If the address signal corresponds to a 0, 
the data is transmitted to a second target. 
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[0046] The SOM 500 includes a data input D and an 

address input A. In one embodiment, the SOM is configured 
to accept two address input signals Al and A2 corresponding 
to the p(A=l) and p(A=0) respectively. The data input D 
may also be configured to accept two data signals Dl and D2 
corresponding to p(D=l) and p(D=l) / respectively. The SOM 
500 has two outputs Q and Q' , each output transmitting a 
signal to a respective target. 

[0047] The SOM 500 includes two soft AND gates 

configured for use in a soft multiplexer ("MAND" gates) 502 
and 504. The first MAND gate 502 outputs Q to the first 
target, and the second MAND gate 504 outputs Q' to the 
second target. Both MAND gates 502 and 504 accept the data 
D as a first input 506. The first MAND gate 502 accpets A 
as a second input 508. The second MAND gate 504 accepts 
NOT A as a second input 510. For example, in a SOM 
embodiment that accepts address signals Al and A2, each 
MAND gate- 502 and 504 has two address input terminals xl 
and x2. For the Q MAND gate 502, Al is transmitted to the 
xl terminal and A2 is transmitted to the x2 terminal. For 
the Q' MAND 504, Al is transmitted to the x2 terminal and 
A2 is transmitted to the xl terminal. 

[0048] Figure 6 is a schematic depiction of a MAND 

gate 600 (e.g., 502 or 504) according to one embodiment of 
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the invention. The MAND gate 600 accepts inputs p(x=0) / 
p(x=l), p(y=0), p(y=l) from terminals xl, x2, yl, and y2 . 
As with the other soft gates described above, transistors 
602 are used to multiply the inputs with one another and 
junctions 604 are used to add the resultant products. The 
illustrative MAND gate 600 outputs two values p(z=0) and 
p(z=l), corresponding to the following equations: 
P z (0) = P y (0) Px (0) + p y (0)p x (1) + p y (\)p x (0) 

P 2 (1) = Py 0)/>, (1) + Py (0)P X (0) + Py (0) Px (1) 

[0049] A SOM 500 designed using the illustrative 

MAND gate generates the following outputs: 

P Q (0) = p D (0)p A (0) + p D (0)p A (1) + p D (\)p A (0) 
P Q (1) = P D <\)Pa 0) + Pd (0)p A (0) + p D (0)p A (1) 
P Q (0) = P D {Q)P A (1) + P D (0)p A (0) + p D (l)p A (1) 
P Q ' (1) = Pd (VPa (0) + Po (VPa (1) + Pd W)Pa (0) 

That is, given that p A (l)=l, the Q output corresponds to D 

and the Q' output corresponds to a probability of .5 

(indicating no information). Similarly, if p A (l)=0, the Q 

output corresponds to a probability of .5 and the Q' output 

corresponds to D. 

[0050] In accordance with the present invention, 

continuous -time delay elements distribute delayed versions 
of analog waveforms. The sequence in which these signal 
portions are processed by computational elements and the 
connections therebetween may implement an algorithm. For 

17 



example, analog filters may distribute different portions 
(typically different temporal portions) of a received 
signal to different soft gates. More generally, 
embodiments of the invention utilize analog filters for 
three purposes: removing high-frequency noise, allowing the 
components of the signal to simultaneously be analyzed in 
states that were received at separate distinct points in 
time, and synchronizing the system with a transmitting 
clock. 

[0051] Analog filters are readily designed to 

implement a given delay. Just as filters can be tuned to 
allow various frequencies to pass, a filter's delay can 
also be tuned by adjusting its phase response function 6 (co) 
(where the phase G is a function of frequency co) . A . 
filter's delay, i d , is equal to the negative first 
derivative of the filter's phase response function. 

d0(a>) 

Id — 

dco 

[0052] A series of analog filters with delays equal 

to whole-number multiples of a period of time, d, behaves 
as a persistent memory with a state capacity equal to the 
number of filters in the series; that is, the series of 
filters acts in a similar fashion to digital shift register 
with a number of registers equal to the number of filters. 
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For example, in Figure 7, a signal propagates through a 
series of four filters generally indicated at 700. The 
first filter 702 imposes a delay, d, and the subsequent 
filters 704, 706, 708 impose delays of 2d, 3d, and 4d, 
respectively. By tapping the system between the first 
filter 702 and the second filter 704, and again after the 
fourth filter 708 at time t, the signal at the first tap 
710 corresponds to the signal at time t-d, and the signal 
at the second tap 712 corresponds to the signal at time t- 
4d. 

[0053] By combining soft logic gates and filters, 

embodiments of the invention can be built to mimic complex 
finite state machines (FSMs) . One approach to implementing 
signal-processing, analysis, or coding/decoding functions 
in accordance with the invention is to represent the 
function as a FSM, and then implement the FSM using delay 
filters and soft gates cascaded so as to implement, in the 
correct order, the operations performed by the soft gates. 
For example, consider a coding system in which a message 
consisting of two bits, itvl and m 2 , is encoded into a three- 
bit message c lt c 2 , c 3 using the following constraints: 

mi -» Ci 
^2 — ► c 2 
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[0054] 



Ci © c 2 = C3 

Accordingly, 



mi 


.nt2 


Ci 


C 2 


c 3 


n 


n 


0 


0 


0 


0 


1 


0 


1 


1 


1 


0 


1 


0 


1 


1 


1 


1 


1 


0 



[0055] 

is : 



The decoding function for a received message 



1 0 0 
0 1 0 



[0056] Figure 8 depicts a flow diagram 800 of a FSM 

that implements the encoding function shown above. The 
message bits mi, m 2 are each fed to an w equals" gate 802i, 
802 2 . The outputs of the equals gates 8021, 802 2 are the 
encoded bits c x and c 2 . The message bits are also fed 
through an XOR gate 804 to obtain the third encoded bit c 3 - 
The three message bits must arrive sequentially at the 
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transmitter so they are sent in the correct order. 
Accordingly, if the input signal contains the sequence mi, 
m 2 , the signals are fed to gates 802 lt 802 2 (implemented as, 
soft gates) via filters imposing a first delay (which may 
be zero, or which may instead scale the input timing to a 
desired transmit timing) and to gate 804 through a filter 
imposing a second delay so that each of the encoded bits 
arrivjes for transmission at the proper time, 

[0057] Embodiments of the invention also capitalize 

on the ability of delay elements with limited bandwidth to 
lend synchronization capability to the system. Much like 
the phenomenon of injection locking, the minimum energy 
state of the receiver system occurs when the receiver is 
synchronized to the transmitter. As unsynchronized 
bitstreams are processed by soft gates, steady signals 
interact with bit edges. These interactions create high- 
frequency noise on both sides of the manipulated bits. 
Figure 9 illustrates, at 900, the approximate results of a 
soft XOR applied to two unsynchronized signals 902, 904. 
Low-pass filters eliminate that noise and as a result 
synchronize the two bitstreams, as shown at 906. 

[0058] Synchronization is highly useful, for 

example, in decoding and signal-acquisition applications. 
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One embodiment of the invention incorporating a FSM is a 
"noise lock loop" 1000 (Figure 10). The loop 1000 can be 
used to acquire, decode, and track a spread spectrum 
communication. 

[0059] A spread spectrum transmitter 1002 sends a 

signal, to at least one of a plurality of users, that is 
the result of modulating a message, M t , by a stream of bits 
created by a pseudo-random number generator 1004. The 
modulation performs a coding function. A user's spread 
spectrum receiver performs mult i -user detection by only 
recovering messages that are sent using that receiver's 
particular modulation code. The receiver requires an exact 
copy of the transmitter's modulation code, which only the 
intended user or users have, in order to recover the 
message transmitted by the sender. 

[0060] The value of outputted bits from the pseudo- 

random noise generator 1004 may depend on states of the 
stream that exist at other points in time. An algorithm 
can model that dependency. Whatever algorithm is used to 
generate the pseudo- random stream of bits, the algorithm 
can be modeled as a FSM. When the spread spectrum signal is 
received, a factor graph corresponding to the transmitter's 
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FSM can be used to demodulate and decode the received 
signal to recover the transmitted message. 

[0061] The noise lock loop 1000 is such a 

demodulating FSM. The noise lock loop comprises a receiver 
1006, a probability module 1008, a decoding FSM 1Q10, and a 
series of delay elements (e.g., filters) and soft logic 
gates (described below) that perform demodulation. 

[0062] The noise lock loop 1000 receives a signal S 

comprising a distorted signal X that is intended to be 
received by at least one of a plurality of users. The 
distortion is caused by noise in the communication channel. 
X further comprises the result of modulating a transmitted 
message M t with a code, the code being chosen to select 
users as intended recipients. X and M t are time-varying 
signals comprising signal components, Xi and m t i/ 
representing digital bits. The loop utilizes a guess of 
the signal, X, which the sender originally intended S to 
be. Eventually the loop 1000 outputs either noise, if the 
loop does not correspond to an intended user recipient, or 
the received message M r/ if the loop corresponds to an 
intended user recipient. In order to recover M t , the noise 
lock loop 1000 synchronizes itself with the transmitter 
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1002, estimates the value of components of the received 
signal S, and demodulates the signal S. 

[0063] The receiver 1006 receives S and passes it 

to the probability module 1008. Based on S and knowledge 
of the noise characteristics of the channel, the 
probability module 1008 outputs the probability signals, P 0 
and Pi. P 0 and P x are defined as the respective 
probabilities that a transmitted signal component xi is 
either 0 or 1, given that the receiver received Si such 
that: £ 

Po,i = P(xi = 0|si) 
Pl.i = P(xi = l|Si) 
Po,i.+ Pl.i = 1. 

[0064] The probability module outputs P 0 and Pi into 

the decoding FSM 1010. The decoding FSM 1010, which 
includes a decoding portion and a feedback portion, 
synchronizes the system with the transmitter 1002, 
eliminates high-frequency noise in S and Y, and further 
guesses the value of signal components M r<i ... M r/m 

[0065] In one embodiment of the noise lock loop 

1000, the first element in the decoding FSM 1010 is a soft 
equals gate 1020. The soft equals gate 1020 is the 
feedback portion of the decoding FSM 1010. The gate 1020 
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receives new input, P 0 and Pi, from the probability module 
1008 and feedback signals, DC 0 and DCi, from the decoding 
portion of the decoding FSM. DC 0 and DC X are the outputs 
from the decoding portion of the decoding FSM 1010. DC 0 and 
DCi are defined as the expected probabilities that the next 
bit will be 0 and 1, respectively, based on guesses of the 
values of signal components at other points in time. 

[0066] If the modulation code of the transmitter 

1002 matches the demodulation code of the decoding FSM 
1010, through the feedback mechanism the outputs. of the 
soft equals gate 1020 settle toward 0 and 100%. If the 
codes differ, the output of the soft equals gate 1020 will 
not settle and no message will be received. The output of 
the soft equals gate 102 0 propagates through the analog 
filters 1032, 1034, 1036, 1038, and eventually becomes the 
output of the noise lock loop 1000. 

[0067] More specifically, the soft equals gate 1020 

outputs its results into the first of a series of analog 
filter delays 1032. The number of delays utilized in a 
particular application depends on the number of distinct 
states in time that the decoding algorithm needs to analyze 
in order to perform its functions. Each filter has a delay 
factor equal to a whole-number multiple of the 
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transmitter's clock rate. The filters have a cutoff 
frequency set just below the clock rate of the transmitter 
1002. As mentioned above, filters perform three separate 
roles in embodiments of the invention. The filters allow 
multiple, temporally disparate components of the signal to 
be simultaneously examined. The filters also remove signal 
components that have frequencies higher than the clock rate 
of the transmitter (i.e., noise), and work to synchronize 
the system with the clock of the transmitter. 

[0068] The remainder of the soft gates in the 

decoding portion 1010 of the noise lock loop 1000 generate 
DC 0 and DCi by simultaneously performing logic operations on 
temporally distinct components of the guessed output, 
signal, each component being drawn from the output of a 
particular filter. For example, the illustrated decoding 
portion 1010 of the noise lock loop 1000 decodes the signal 
modulated by the digital pseudo-random number generator G. 
G' s output at time t is equal to the XOR of G' s output at 
times t-d and t-4d. 

[0069] The analog filters in the illustrated noise 

lock loop 1000 have delay factors equal to d, 2d, 3d, and 
4d. The series of filters is tapped after the first filter 
1032 and after the fourth filter 1038. The taps carry 
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signal components corresponding to probabilities of guesses 
of the message components at times t-d and t-3d to a soft 
XOR gate 1044, generating the probability signals DC 0 and 
DCi described above . 

[0070] Finally, tapping the noise lock loop 1000 

after its last delay 1038 provides the output, M r . The 
signal carried on the filter output equivalent to the 
probability that the signal is a one should closely 
resemble the bitstream M t . 

[0071] Those skilled in the art will recognize that 

the invention can be utilized to implement a large variety 
of signal-processing, analysis,' and decoding circuits. For 
instance, the invention may be used to perform statistical 
estimation, for example in radio front-ends. In other 
exemplary embodiments, the invention can derive statistics 
from baseband, IF, or carrier signals. These statistics 
can be used to perform tasks such as interference 
rejection, multiple user detection, decoding, and error 
correction decoding, interference cancellation, carrier 
tracking, parameter tuning for filters, gain estimation for 
automatic gain control, transmitter modeling, environmental 
modeling, channel modeling, and channel equalization. 
[0072] The invention's statistical estimation 

ability further allows for embodiments to be incorporated 
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into imaging, measurement, or range -finding devices such as 
nuclear magnetic resonance devices, radar, and ultrasounds. 
The invention would perform interference rejection, 
interference cancellation, multiple user decoding, error 
correction decoding, carrier tracking, parameter tuning for 
filters, automatic gain control, transmitter modeling, 
environmental modeling, channel modeling, and/or channel 
equalization functions . 

[0073] The invention may also be used for timing 

recovery and synchronization in ultra-wide-band 
applications. For example, the invention may be used to 
implement a novel approach to radio communication 
transceiver design that may be termed "sequence shift 
keying" (SSK) . An SSK radio can be built without phase 
lock loops for performing timing ^recovery in the receiver. 
In an SSK radio, the transmitter is implemented as an 
encoder that outputs bits with spectral characteristics 
matched to the channel transfer function. The received 
signal is passed directly into a system of filters and soft 
gates, in accordance with the invention, which implements 
timing recovery, demodulation and decoding by combining 
entrainment with statistical estimation. Alternatively, a 
conventional radio front -end may be combined with a SSK 
approach so that the transmitted base-band signal is up- 
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converted by mixing it with a conventional sinusoidal 
carrier for transmission in the channel, and then down- 
converted by conventional methods in the receiver. The SSK 
block may perform mult i -user decoding, error correction 
decoding, and/or decompression operations. 
[0074] Embodiments of the invention can also 

provide synchronization for signals propagating through 
high-speed computers. In addition, embodiments of the 
invention can replace the A/D converters that PC 
motherboards use to remove inter- symbol interference 
introduced within the computer's bus, allowing for higher 
processing speeds. Indeed, the invention may obviate the 
need for clocks in large asynchronous logic systems. 
[0075] The invention's ability to replace digital 

systems that implement probabilistic graphical models, such 
as Hidden Markov Models and Markov Random Fields, allows 
for design of faster and more accurate voice and vision 
pattern recognition devices. 

[0076] The terms and expressions employed herein 

are used as terms of description and not of limitation, and 
there is no intention, in the use of such terms and 
expressions, of excluding any equivalents of the features 
shown and described or portions thereof, but it is 
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recognized that various modifications are possible within • 
the scope of the invention claimed. 
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